METHOD AND APPARATUS FOR PROCESSING IMAGE DATA AND 

COMPUTER PROGRAM 

BACKGROUND OF THE INVENTION 

1) Field of the Invention 

This invention relates to embedding a predetermined code into 
one color component of image data. 

2) Description of the Related Art 

As disclosed in drawings of the specification of United States 
Patent No. 5,636,292 and Japanese Patent Application Laid-Open No. 
2000-299779, a technique for embedding a code (different data) into 
image data or voice data has been conventionally applied to counterfeit 
forgery, to prevent illegal use, and to provide other services. 

Because this technique is used for security purposes, 
conventional methods have been used against tampering of data. For 
example, quite complicated methods such as a method of arranging 
identical codes in an image in a distributed manner, and an electronic 
watermark technique of inserting a code in a frequency region using 
FFT (Fast Fourier Transform) have been conventionally used. 

The electronic watermark technique is applied to various other 
services. For example, the drawings of the specification of United 
States Patent No. 5,841,978 disclose a method of reading an electronic 
watermark embedded in printed matter and displaying a specific web 
page. 
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However, the conventional electronic watermark technique is 
required to perform an enormous amount of FFT calculation to insert 
the code into the frequency region. Portable information devices such 
as a cellular phone, a PHS (Personal Handyphone System), or a PDA 
5 (Personal Digital Assistant) include resources, such as a memory and a 
processor, having limited processing performance. Therefore, in a 
portable information device, it is difficult to carry out embedding code 
into and reading out the code from the image data within practical 
processing time. 

10 Japanese Patent Application Laid-Open No. 2000-165640 

discloses an electronic watermark technique that does not perform FFT 
calculation. The image processing apparatus in this patent literature 
embeds additional data into Y (yellow) component of image data printed 
in colors of CMYK (cyan, magenta, yellow, and black). 

15 Specifically, a plurality of patterns are embedded into the Y 

component image data, which is visually inconspicuous, and a "0" or "1" 
code is discriminately set depending on the type of pattern embedded. 
While embedding patterns, if densities of CMK components of the 
image data are higher, amplitude of pixel value fluctuation of the Y 

20 component is set higher. By doing so, even if the densities of the CMK 
components are high in the printed image, the embedded patterns can 
be easily detected. 

However, reflected wavelengths of the CM components in actual 
print inks are not reflected wavelengths of pure CM components, but 

25 include reflected wavelengths of the Y component as unnecessary 



reflected wavelengths. Therefore, the prior art disclosed by the 
Japanese Patent Application Laid-Open No. 2000-165640 has a 
disadvantage in that the pixel value of the Y component in the actual 
printed image changes and the change in pixel value adversely affects 
5 accuracy of detecting the code from the Y component in the printed 
image. 

Furthermore, at the time of printing the image data, a printer 
driver adjusts proportions of the CMK components so as to provide a 
finer image. If the pixel value of the Y component used to embed the 

1 0 code is set based on the densities of the CMK component of the image 
data, the pixel value of the Y component in the actual printed image 
further changes due to the adjustment done by the printer driver. As a 
result, it is difficult to set the pixel value of the Y component that is 
used to embed the code. 

15 To overcome this problem, the amplitude of the pixel value 

fluctuation of the Y component may well be set high in advance. 
However, there is a disadvantage in that the patterns embedded into 
the image data are conspicuous on the printed image. The prior art 
disclosed in the Japanese Patent Application Laid-Open No. 

20 2000-165640, therefore, fails to show a specific method of setting 
appropriate amplitude. 

To deal appropriately with the unnecessary reflected 
wavelengths of the Y component included in the CM components, it is 
required to adjust the pixel value of the Y component embedded into 

25 the code in accordance with color characteristics of the printed image 



data and not color characteristics of the original image. The same is 
true for three primary colors RGB (Red, Green, and Blue) 
complementary to the colors CMY. 

5 SUMMARY OF THE INVENTION 

It is an object of the invention to at least solve the problems in 
the conventional technology. 

An image data processing apparatus according to an aspect of 
the present invention includes a dividing unit that divides image data 

10 into a plurality of blocks; an extracting unit that extracts a feature index 
of a first color component and a feature index of a second color 
component in each of the blocks; a registration unit that registers 
information about a correspondence between the feature index of the 
second color component and a change in the feature index for the first 

1 5 color component; and a code embedding unit that embeds a 

predetermined code into the image data, by changing the feature index 
of the first color component based on the feature index of the second 
color component, using the information registered. 

An image data processing method according to another aspect 

20 of the present invention includes dividing image data into a plurality of 
blocks; extracting a feature index of a first color component and a 
feature index of a second color component in each of the blocks; 
registering information about a correspondence between the feature 
index of the second color component and a change in the feature index 

25 for the first color component; and embedding a predetermined code into 



the image data, by changing the feature index of the first color 
component based on the feature index of the second color component, 
using the information registered. 

A computer program according to another aspect of the present 
5 invention makes a computer realize the method according to the 
present invention on a computer. 

The other objects, features, and advantages of the present 
invention are specifically set forth in or will become apparent from the 
following detailed descriptions of the invention when read in conjunction 
10 with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of an encoder according to a first 
embodiment of the present invention; 
15 Fig. 2 is a graph illustrating a relationship between change in 

density of a yellow component image and a gray-scale image, and a 
mean opinion score (MOS); 

Fig. 3A illustrates a relationship between wavelengths of ideal 
ink and reflectance; 
20 Fig. 3B illustrates a relationship between wavelengths of actual 

inks and reflectance; 

Fig. 4A illustrates an example of an actual yellow component 
that is generated from a yellow component and a magenta component 
having an unnecessary wavelength of the yellow component in its 
25 wavelength range; 



Fig. 4B illustrates an instance in which the magenta component 
has an effect on the yellow component; 

Fig. 5 illustrates block division image data output by a block 
division section; 

5 Fig. 6 illustrates coded image data output by the encoder; 

Fig. 7 is an illustration for explaining a pixel value change 
process performed by the encoder; 

Fig. 8 is an illustration for explaining a process of setting the 
difference T for the respective blocks; 
10 Fig. 9 illustrates one example of coefficient information 

registered in a coefficient registration section; 

Fig. 10A and Fig. 10B are flowcharts of an operation of the 
encoder 100; 

Fig. 11 is a block diagram of a decoder according to the first 
15 embodiment; 

Fig. 12 is an illustration for explaining how the decoder 
determines the code from a group of candidate codes; 

Fig. 13 is a flowchart of an operation of the decoder; 

Fig. 14 is a block diagram of an encoder according to a second 
20 embodiment; 

Fig. 15 illustrates coefficient information registered in a 
coefficient registration section; 

Fig. 16A and Fig. 16B are flowcharts of an operation of the 
encoder; and 

25 Fig. 17 illustrates a configuration of a modification of the 



embodiments of the present invention. 

DETAILED DESCRIPTION 

Exemplary embodiments of an apparatus and a method for 
5 processing image data, and a computer program according to the 
present invention will be explained in detail with reference to the 
accompanying drawings. 

Fig. 1 is a block diagram of the encoder 100 according to a first 
embodiment of the present invention. The encoder 100 embeds a 
10 code C into a yellow component of the original image data 10, and 
generates the coded image data 12. 

The original image data 10 is generated in a predetermined 
format, for example, JPEG (Joint Photographic Expert Group) or TIFF 
(Tagged Image File Format), and with a size of 1024x1024 pixels. A 
15 code C of 16 bits (1010110101001010), for example, is embedded into 
the yellow component of the original image data 10. 

For embedding a code into an image, a method of embedding a 
code into a gray-scale image (monochrome image) obtained by 
converting a color image to brightness, or a method of embedding a 
20 code into one of the three primary color components (a cyan component, 
a magenta component, and the yellow component) of the image, may 
be used. For example, code may be embedded into a yellow 
component. 

The latter method is advantageous over the former method in 
25 that even if pixel value is changed, it is difficult for the human eye to 

7 



discriminate an unchanged pixel value from a changed pixel value. Fig. 
2 is a graph illustrating a relationship between a change in pixel value 
of a yellow component image and a gray-scale image, and an MOS 
(Mean Opinion Score). 
5 This graph is obtained after a subjective evaluation method that 

is specified by International Commission on Illumination (ITU-T), and 
that is well known as an image evaluation method. According to the 
subjective evaluation method, if the image changed by as much as a 
pixel value change quantity cannot be visually discriminated from the 
10 original image, the quality of the image is evaluated as five MOS. If 
the difference is greater, the quality of the image is evaluated as lower 
MOS. 

As can be seen from the graph, the yellow component (indicated 
as "ye |low ") has a higher MOS than the brightness component 

15 (indicated as "brightness") even if the change in pixel value is increased. 
Therefore, with the method of changing the pixel value of the yellow 
component, it is difficult for the human eye to discriminate the 
unchanged image from the changed image. 

A printer prints the coded image data generated by the encoder 

20 100, using cyan, magenta, and yellow ink. An input device such as a 
scanner or a camera reads the coded image data printed, and a 
decoder 200 (see Fig. 11) extracts the code embedded into the coded 
image data. 

However, the magenta ink and the cyan ink used for printing 
25 include reflected wavelengths of the yellow component as unnecessary 



reflected wavelengths. As a result, the magenta ink and the cyan ink 
adversely affect extracting of the code embedded into the yellow 
component of the image. 

Fig. 3A illustrates a relationship between wavelengths of ideal 
5 ink and reflectance. Fig. 3B illustrates a relationship between 

wavelengths of actual ink and reflectance. As illustrated in Fig. 3A, in 
ideal ink, reflectance of the cyan component and that of the magenta 
component do not coincide with the reflectance of the yellow component. 
Therefore, the cyan, magenta, and yellow. components have no effect 

10 on one another. 

However/in actual ink, (see Fig. 3B), the reflectance of the cyan 
component and that of the magenta component are not perfectly "1" or 
"0", unlike in Fig. 3A. A wavelength range of the yellow component is 
included as an unnecessary wavelength range in both, the cyan 

15 component and the magenta component. Therefore, if the code is 

embedded into the yellow component of the image, the influence of the 
unnecessary wavelength range included in the cyan component and the 
magenta component makes it difficult to acquire the code. 

Fig. 4A illustrates one example of an actual yellow component 

20 that is generated from the yellow component and the magenta 

component having an unnecessary wavelength of the yellow component 
in its wavelength range. Fig. 4B illustrates an instance in which the 
magenta component has an effect on the yellow component. 

As illustrated in Fig. 4A, for the pixel value "30" of the magenta 

25 component that has an unnecessary wavelength range of the yellow 



component included in its wavelength range, a magnitude relationship 
between the densities "20" and "10" of the yellow components and the 
densities "21" and "13" of the actual yellow components generated, is 
identical. Namely, of the two cases, if the pixel value of the yellow 
5 component is high, the pixel value of the actual yellow component 
generated is also high. 

However, as illustrated in Fig. 4B, if the pixel value of the 
magenta component changes from "30" to "40", for example, the 
magnitude relationship between the densities "20" and "10" of the 

10 yellow components and the densities "21" and "25" of the actual yellow 
components generated, is often reversed. This is due to the effect of 
the unnecessary reflected wavelengths included in the reflected 
wavelengths of the magenta component as explained with reference to 
Fig. 3B. Further, the effect of the unnecessary reflected wavelengths 

15 varies according to the type of ink. 

In consideration of the above respects, the encoder 100 adjusts 
the densities of the yellow components by as much as predetermined 
quantities (changes "20" to "25" and "10" to "5") so as to satisfy the 
magnitude relationship between the densities of the yellow components 

20 and the densities of the actual yellow components generated from the 
magenta component and the yellow component. 

The change in the pixel value of the yellow component is 
determined by experiments, or analyzing parameters of a color 
conversion system in a printer driver. Specifically, the change in the 

25 pixel value the yellow component corresponding to the pixel value of 
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various magenta components is determined, so as to be able to detect 
the code C with higher accuracy while suppressing image degradation. 

The change in the densities of the yellow components thus 
determined is stored in correlation to the pixel value of the respective 
5 magenta component. If the pixel value of the yellow component is to 
be changed, then the change in the pixel value of the yellow component 
corresponding to the pixel value of the magenta component is extracted, 
the change in the pixel value is applied to the yellow component, and 
the pixel value of the yellow component is thus changed. 

10 This makes it possible to deal with the adverse effect of the 

unnecessary reflected wavelengths of the yellow component included in 
the reflected wavelengths of the magenta ink, on code detection, and to 
improve the code detection efficiency. Further, using the yellow 
component having characteristics closer to ideal characteristics for 

15 embedding code, it is possible to suppress image degradation without 
greatly affecting the cyan and magenta components. 

Referring back to Fig. 1, a block division section 101 in the 
encoder 100 divides the input original image data 10 into bocks in N 
rows by M columns (blocks of 16 rows by 16 columns in the example 

20 illustrated in Fig. 5), and outputs the divided blocks as block division 
image data 11 . 

The block division image data 11 includes blocks B M1 , B r11 , 
Bus, B r18 , B121, B r2 i, and B| 16 8, B r168 , i.e., 256 blocks in all. Each 
block has a size of 64 * 64 pixels. 
25 A code of one bit is embedded into each pair of blocks (two 



adjacent blocks) in the block division image data 11. 

Specifically, the paired blocks are the blocks B M1 and B r11l the 
block B| 12 and B r i 2 , the blocks B M8 and B r i 8 (in a first row), the 
blocks B121 and B r2 i, the blocks B, 28 and B r28 (in a second row), 
5 the blocks B M61 and B r161l and the blocks B M68 and B r168 (in a 
sixteenth row). 

As for block B| Xy and block B rxy in one pair of blocks, a subscript 
I represents that the block is a left-side block in the pair, a subscript r 
represents that the block is a right-side block in the pair, a subscript x 

10 represents the row (N) of the block, and a subscript y represents the 
column (M) of the block. 

Further, in the paired blocks, a yellow component mean pixel 
value as a feature index of the yellow component in the left block B| Xy (a 
mean gradation of the pixels in the block) is assumed as yellow left-side 

15 mean pixel value data D y i, and that in the right block B rxy is assumed as 
yellow right-side mean pixel value data D yr . 

If the yellow left-side mean pixel value data D y! is less than the 
yellow right-side mean pixel value data D yr , the one-bit code embedded 
into the paired blocks is determined as "0" using the relational formula 

20 given below. If the yellow left-side mean pixel value data D y i is equal 
to or more than the yellow right-side mean pixel value data D yr , the 
one-bit code embedded into the paired blocks is determined as "1" 
using the following relational formula. This process is hereinafter 
referred to as "bit determination". 

25 D y ,<D yr "0" 



Dy, D yr -1- 

ln addition, in the block division image data 11, eight paired 
blocks (16 blocks) are present per row. Therefore, one row represents 
a code of eight bits. Accordingly, all rows (16 rows) represent a code 
5 of 128 bits. According to the first embodiment, the code C embedded 
into the block division image data 11 has 16 bits. Therefore, it is 
possible to embed the code C into the block division image data 11, 
eight (128/16) times (see Fig. 6). 

Referring back to Fig. 1, a block extraction section 102 
10 sequentially extracts the paired blocks (blocks B| Xy and B rxy ) from the 
block division image data 11 (see Fig. 5) so as to follow a bit shift of the 
code C, and sequentially outputs pixel value distributions of the yellow 
component and the magenta component in the blocks B| Xy and B rxy as 
yellow block pixel value data D y and magenta block pixel value data D m , 
1 5 respectively. 

The "bit shift of the code C" means that a bit pointer is shifted to 
the right, bit by bit, from leftmost bit "1" to rightmost bit "0". 

A yellow averaging section 103 calculates the yellow left-side 
mean pixel value data D y i corresponding to the block B| Xy and the yellow 
20 right-side means pixel value data D yr corresponding to the block B rxy 

from the magenta block pixel value data D m , and sequentially stores the 
calculated data D y i and D yr in registers 104| and 104 r , respectively, so 
as to follow the bit shift of the code C. 

A magenta averaging section 105 calculates the magenta 
25 left-side mean pixel value data D m! corresponding to the block B !xy and 
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the magenta right-side means pixel value data D mr corresponding to the 
block B rxy from the magenta block pixel value data D m> and sequentially 
stores the calculated data D m i and D mr in registers 106| and 106 r , 
respectively, so as to follow the bit shift of the code C. 
5 A comparison section 107 compares an n-th bit of the code (n=1, 

2, 16 from the leftmost bit of the code) with a bit determination result 
determined based on the magnitude relationship between the yellow 
left-side mean pixel value data D y i and the yellow right-side mean pixel 
value data D yr stored in registers 1 04 t and 104 n respectively. 

10 A coefficient registration section 108 registers information about 

the change in the block mean pixel value of the yellow component 
corresponding to the magenta left-side mean pixel value data D m i 
calculated by the magenta averaging section 105. Specifically, the 
coefficient registration section 108 registers information about 

15 coefficients of mathematical formulas (see Fig. 8) employed to change 
the block mean pixel value of the yellow component (see Fig. 9). 

Fig. 9 illustrates one example of coefficient information 
registered in the coefficient registration section 108. The magenta 
left-side mean pixel value data D ml , which ranges from "0" to "255", and 

20 the coefficients are stored in correlated form. 

For instance, in the coefficient information 108a, the magenta 
left-side mean pixel value data D m i "0 to 25" corresponds to the 
coefficient "3", the magenta left-side mean pixel value data D mi "26 to 
50" corresponds to the coefficient "2", the magenta left-side mean pixel 

25 value data D m i "51 to 200" corresponds to the coefficient "1", and the 



magenta left-side mean pixel value data D mi "201 to 255" corresponds 
to the coefficient "2". 

An encoding section 109 executes a process for embedding the 
code C into the block division image data 11 based on a result output by 
5 the comparison section 107, the magenta left-side mean pixel value 
data D m i and magenta right-side mean pixel value data D mr . 

That is, if the result of the comparison section 107 indicates that 
the n-th bit of the code C matches the bit determination result, the 
encoding section 109 sets the difference between the yellow left-side 

10 mean pixel value data D y i and the yellow right-side mean pixel value 
data D yr to a predetermined value T, while satisfying the magnitude 
relationship between the yellow left-side mean pixel value data D y) and 
the yellow right-side mean pixel value data D yr , so as to improve 
decoding efficiency. If the comparison result indicates otherwise, the 

15 encoding section 109 inverts the yellow left-side mean pixel value data 
D y i and the yellow right-side mean pixel value data D yr so as to satisfy 
the magnitude relationship and to match the bits of the code C. 
Thereafter, the encoding section 109 generates and outputs the coded 
image data 12 (see Fig. 6). 

20 Specifically, if the magnitude relationship D y i < D yr between the 

yellow left-side mean pixel value data D y! and the yellow right-side 
mean pixel value data D yr is satisfied, or if the yellow left-side mean 
pixel value data D yi and the yellow right-side mean pixel value data D yr 
are inverted to satisfy the magnitude relationship D y i<D yr , the encoding 

25 section 109 calculates changed yellow left-side mean pixel value data 

15 



D'yi from the formula (1) for case (A) D yl <D yr and then calculates 
changed yellow right-side mean pixel value data D' yr from the formula 
(2), as illustrated in Fig. 7. 

The predetermined value T is initialized (e.g., T=T0=10), and the 
5 yellow left-side mean pixel value data D' y i and the yellow right-side 
mean pixel value data D' yr are calculated. Thereafter, using the 
magenta left-side mean pixel value data D m i and the magenta right-side 
mean pixel value data D mr calculated by the magenta averaging section 
105, the value of T is reset according to conditions illustrated in Fig. 8. 

10 Namely, if (A) D' y i<D' yr and D m i<D mr or if D'y^DV and D m i>D mr , 

the encoding section 109 substitutes the value T from a formula (5) in 
formulas (1) to (4). If (B) D' y i<D' yr and D m , D mr or if D'y^DV and 
Dmi Dmr, the encoding section 109 substitutes the value T from a 
formula (6) in the formulas (1) to (4). 

15 A coefficient in the formula (6) is acquired from the coefficient 

information 108a illustrated in Fig. 9 and corresponds to the magenta 
left-side mean pixel value data D m |. For instance, case (A) of Fig. 8 
corresponds to one in which the coefficient corresponding to each 
magenta left-side mean pixel value data D m! is "1". 

20 On the other hand, if the magnitude relationship D y i D yr between 

the yellow left-side mean pixel value data D y iand the yellow right-side 
mean pixel value data D yr is satisfied, or if values are inverted to satisfy 
the magnitude relationship D y i D yr , then the encoding section 109 
calculates the changed yellow left-side mean pixel value data D' y i from 

25 the formula (3) for case (B) D y i D yr and then calculates the changed 



yellow right-side mean pixel value data D' yr from the formula (4). A 
method of setting the value T is the same as the method used for (A) 
Dyt<D yr illustrated in Fig. 7. 

In this embodiment, in the coefficient information 108a, the 
5 magenta left-side mean pixel value data D m i and the coefficient 

information are stored in correlated form. Alternatively, the magenta 
right-side mean pixel value data D mr , magenta mean pixel value data 
that is an average of the magenta left-side mean pixel value data D mt 
and the magenta right-side mean pixel value data D mr , and the 

10 coefficient information may be stored in correlated form. 

If the above alternative is adopted, the coefficient corresponding 
to the magenta right-side mean pixel value data D m i or the magenta 
left-side mean pixel value data D mr is extracted from the coefficient 
information 108a for the paired blocks to be subjected to a pixel value 

15 change processing, and the changed yellow left-side mean pixel value 
data D'yi and the changed yellow right-side mean pixel value data D' yr 
are calculated based on the coefficient. 

Furthermore, the calculation formulas for the yellow left-side 
mean pixel value data D' y i and the yellow right-side mean pixel value 

20 data D' y r explained with reference to Figs. 7 and 8 are given only as an 
example, and may be calculated according to the magenta mean pixel 
value data D m i using other formulas. 

The coded image data 12 illustrated in Fig. 6 corresponds to the 
block division image data 11 illustrated in Fig. 5 and the original image 

25 data 10, and includes regions A, to A 8 . The same code C 
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(1010110101001010) is embedded into the regions A^ to A 8 eight times. 
For instance, the region A<\ corresponds to the blocks B M1 , B r11 , 
and Bl 2 a, B r2 8- The other regions A 2 to A 8 correspond to the blocks 

BI3I. B r 3i, Bl 168 , B r i68- 

5 While Fig. 6 illustrates a state in which the code C has been 

embedded, the actual coded image data 12 corresponds to image data 
substantially equal to the original image data 10. The image data 
cannot be discriminated from the original image data 10 with naked eyes 
although some blocks having changed densities are often present. 
10 Furthermore, the respective constituent elements of the encoder 

100 are connected to one another through a control section, which is 
not shown in Fig. 1 . 

Figs. 10A and 10B are flowcharts for explaining the operation of 
the encoder 100. 

15 Referring to Fig. 10A, at step SA1, the code C is set in the 

comparison section 107. At step SA2, the comparison section 107 
initializes n to 1. As explained above, n represents the bit pointer of 
the code C. In this example, n = 1 corresponds to the leftmost bit ("1") 
of the code C. 

20 At step SA3, the original image data 10 is input to the block 

division section 101. At step SA4, the block division section 101 
divides the original image data 10 into the blocks B m to B r16 8 in 16 rows 
by 16 columns as illustrated in Fig. 5, and sends the image data to the 
block extraction section 102 as the block division image data 11. 

25 At step SA5, the block extraction section 102 extracts paired 

18 



blocks (the blocks B h1 and B r11 in this example) corresponding to the 
value of n (n = 1 in this example) from the block division image data 11, 
and outputs the yellow and magenta component pixel value distribution 
in the blocks B m and B r11 to the yellow averaging section 103 and the 
5 magenta averaging section 105 as the yellow block pixel value data D y 
and the yellow block pixel value data D m , respectively. 

At step SA6, the yellow averaging section 103 executes an 
averaging process to calculate the yellow left-side mean pixel value 
data D yM1 corresponding to the block B M1 and the yellow right-side mean 

10 pixel value data D yr n corresponding to the block B r11 from the yellow 
block pixel value data D y . Similarly, the magenta averaging section 
105 executes an averaging process to calculate the magenta left-side 
mean pixel value data D mi11 corresponding to the block B m and the 
magenta right-side mean pixel value data D mr11 corresponding to the 

15 block B r11 from the magenta block pixel value data D m . 

At step SA7, the yellow averaging section 103 stores the yellow 
left-side mean pixel value data D ym and the yellow right-side mean 
pixel value data D yr11 in an L register 1041 and an R register 104 r , 
respectively. The magenta averaging section 105 stores the magenta 

20 left-side mean pixel value data D m)11 and the magenta right-side mean 
pixel value data D mr11 in an L register 1061 and an R register 106 r , 
respectively. 

At step SA8, the comparison section 107 extracts the leftmost 
bit of the code C (corresponding to n=1), i.e., "1", calculates the pixel 
25 value difference between the yellow left-side mean pixel value data D y m 
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and the yellow right-side mean pixel value data D yr n stored in registers 
104| and 104 r , respectively, and executes bit determination based on 
the pixel value difference. 

If the yellow left-side mean pixel value data D yM1 is higher than 
5 the yellow right-side mean pixel value data D yr ii, the comparison 
section 107 determines that the bit for the paired block is "1". 

As illustrated in Fig. 10B, at step SA9, the comparison section 
107 determines whether the n-th bit of the code C matches the bit 
determination result at the step SA8. In this example, the comparison 

10 section 107 determines that the two values match (Yes at step SA9). 

At step SA10, the encoding section 109 executes a pixel value 
difference change process for setting the pixel value difference between 
the yellow left-side mean pixel value data D y i and the yellow right-side 
mean pixel value data D yr to T so as to satisfy the magnitude 

15 relationship between the yellow left-side mean pixel value data D y! and 
the yellow right-side mean pixel value data D yr . Specifically, the 
encoding section 109 uses the formulas illustrated in Figs. 7 and 8 and 
the coefficient information 108a illustrated in Fig. 9 for setting the pixel 
value difference to T. 

20 At step SA11, the comparison section 107 increments n by one. 

As a result, the value of n is two. At step SA12, the comparison 
section 107 determines whether n is greater than 'nend', where 'nend' 
is the total number of bits in the code C (16 in this example). Since n 
is two, the comparison section 107 determines that n is not greater than 

25 'nend' (No at step SA12). Therefore, the process from step SA5 of Fig. 



10A is repeated. 

The block extraction section 102 extracts the paired blocks B M2 
and B r12 corresponding to n=2 from the block division image data 11, 
and outputs the yellow and magenta component pixel value distribution 
5 in the blocks B| 12 and B r12 to the yellow averaging section 103 and the 
magenta averaging section 105 as the yellow block pixel value data D y 
and the magenta block pixel value data D m , respectively. 

At step SA6, the yellow averaging section 103 executes an 
averaging process to calculate the yellow left-side mean pixel value 

10 data D y n2 corresponding to the block B M2 and the yellow right-side 
mean pixel value data D yr12 corresponding to the block B r12 from the 
yellow block pixel value data D y . Similarly, the magenta averaging 
section 105 executes an averaging process to calculate the magenta 
left-side mean pixel value data D mM2 corresponding to the block B M2 and 

15 the magenta right-side mean pixel value data D mr12 corresponding to the 
block B r12 from the magenta block pixel value data D m . 

At step SA7, the yellow averaging section 1 03 stores the yellow 
left-side mean pixel value data Dy M2 and the yellow right-side mean 
pixel value data D yr12 in the L register 1041 and the R register 104 r , 

20 respectively. The magenta averaging section 105 stores the magenta 
left-side mean pixel value data D mM2 and the magenta right-side mean . 
pixel value data D mM2 in the L register 1061 and the R register 106 r , 
respectively. 

At step SA8, the comparison section 107 extracts the next bit of 
25 the code C (corresponding to n=2), i.e., "0", calculates the pixel value 



difference between the yellow left-side mean pixel value data D y i 12 and 
the yellow right-side mean pixel value data D yr12 stored in the registers 
104| and 104 r , respectively, and executes bit determination based on 
the pixel value difference. 
5 If the yellow left-side mean pixel value data D y i 12 is lower than 

the yellow right-side mean pixel value data D yr i 2 , the comparison 
section 107 determines that the bit for the paired blocks is "0". 

As illustrated in Fig. 10B, at step SA9, the comparison section 
107 determines whether the n-th bit of the code C (second bit or "0") 

10 matches the bit determination result ("0") of the step SA8. In this 
example, the comparison section 107 determines that the two values 
match (Yes at step SA9). 

At step SA10, the encoding section 109 executes a pixel value 
difference change process for setting the pixel value difference between 

15 the yellow left-side mean pixel value data D y! and the yellow right-side 
mean pixel value data D yr to T so as to satisfy the magnitude 
relationship between the yellow left-side mean pixel value data D y i and 
the yellow right-side mean pixel value data D yr . Specifically, the 
encoding section 109 uses the formulas illustrated in Figs. 7 and 8 and 

20 the coefficient information 108a illustrated in Fig. 9 for setting the pixel 
value difference to T. 

At step SA11, the comparison section 107 increments n by one. 
As a result, the value of n is set to three. At step SA12, the 
comparison section 107 determines whether n (=3) is greater than 

25 'nend' (=16). The comparison section 107 determines that n (=3) is 



not greater than 'nencT (No at step SA12). Thereafter, the operation 
from step SA5 is repeated until n is equal to17 (Yes at step SA12). 

When n is set to 16 at the step SA11, the process jumps to step 
SA5. The block extraction section 102 extracts the paired blocks B !28 
5 and B r2 8 corresponding to n=16 from the block division image data 11, 
and outputs the yellow and magenta component pixel value distribution 
in the blocks B| 28 and B r2 8 to the yellow averaging section 103 and the 
magenta averaging section 105 as the yellow block pixel value data D y 
and the magenta block pixel value data D m , respectively. 

10 At step SA6, the yellow averaging section 103 executes an 

averaging process to calculate the yellow left-side mean pixel value 
data D y i 28 corresponding to the block B i28 and the yellow right-side 
mean pixel value data D yr28 corresponding to the block B r28 from the 
yellow block pixel value data D y . Similarly, the magenta averaging 

15 section 105 executes an averaging process to calculate the magenta 

left-side mean pixel value data D m i 28 corresponding to the block B| 28 and 
the magenta right-side mean pixel value data D mr28 corresponding to the 
block B r28 from the magenta block pixel value data D m . 

At step SA7, the yellow averaging section 103 stores the yellow 

20 left-side mean pixel value data D y i 28 and the yellow right-side mean 
pixel value data D yr28 in the L register 1041 and the R register 104 n 
respectively. The magenta averaging section 105 stores the magenta 
left-side mean pixel value data D m | 28 and the magenta right-side mean 
pixel value data D mr28 in the L register 1061 and the R register 106 r , 

25 respectively. 
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At step SA8, the comparison section 107 extracts the right-side 
bit of the code C (corresponding to n=16), i.e., "0", calculates the pixel 
value difference between the yellow left-side mean pixel value data 
D y i28 and the yellow right-side mean pixel value data D yr2 8 stored in 
5 registers 104| and 104 r , respectively, and executes bit determination 
based on the pixel value difference. 

If the yellow left-side mean pixel value data D y i 2 8 is equal to or 
higher than the yellow right-side mean pixel value data D yr28 , the 
comparison section 107 determines that the bit for the paired block is 
10 "1". 

As illustrated in Fig. 10B, at step SA9, the comparison section 
107 determines whether the n-th bit of the code C (16th bit or "0" in this 
example) matches the bit determination result ("1" in this example) at 
the step SA8. In this example, the comparison section 107 determines 

15 that the two values do not match (No at step SA9). 

At step SA15, the comparison section 107 determines whether 
the pixel value difference (e.g., 10) calculated at the step SA8 is equal 
to or less than a preset upper limit threshold (e.g., 100). In this 
example, the comparison section 107 determines that the pixel value 

20 difference is equal to or less than the preset upper limit threshold (Yes 
atstepSA15). 

At step SA16, the encoding section 109 executes a pixel value 
inversion process for inverting the magnitude relationship between the 
yellow left-side mean pixel value data D yl2 8 and the yellow right-side 
25 mean pixel value data D yr28 so that the bit determination result matches 
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the n-th bit (16th bit of "0" in this example) of the code C. 

Namely, the encoding section 109 sets the yellow left-side mean 
pixel value data D y i 2 8 lower than the yellow right-side mean pixel value 
data D y r28 using the formulas illustrated in Figs. 7 and 8 and the 
5 coefficient information 108a illustrated in Fig. 9. 

If the pixel value difference calculated at step SA8 is greater 
than the preset upper limit threshold (No at step SA15), then the 
process at step SA11 is executed without changing the pixel value. 

The reason for omitting the change of pixel value is as follows. 
10 If the pixel value difference between the paired blocks is large and the 
pixel value change process is executed, the pixel value change is 
visually apparent. Therefore, the pixel value is not changed 
intentionally to prevent image degradation or generating an unnatural 
image. 

15 At step SA11, the comparison section 107 increments n by one. 

As a result, n is set to 17. At step SA12, the comparison section 107 
determines whether n (=17) is greater than 'nend' (=16). In this 
example, the comparison section 107 determines that n is greater than 
'nend' (Yes at step SA12). 

20 At step SA13, the comparison section 107 determines whether 

the final pair of blocks (blocks B M68 and Bries) in the block division 
image data 11 has been processed. In this example, the comparison 
section 107 determines that the processing is not finished (No at step 
SA13). 

25 At a step SA17, the comparison section 107 resets n to one. 
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As illustrated in Fig. 10A, at step SA5, the block extraction section 102 
extracts the pair of blocks B !3 i and B r3 i corresponding to n=1 from the 
block division image data 11, and outputs the yellow and magenta 
component pixel value distribution in the blocks B| 31 and B r31 to the 
5 yellow averaging section 103 and the magenta averaging section 105 
as the yellow block pixel value data D y and the magenta block-pixel 
value data D m , respectively. 

Thereafter, the operation is repeated until the final block has 
been processed (Yes at step SA13. 

10 If the determination result of step SA13 is "Yes", the encoding 

section 109 generates the coded image data 12 based on the 
determination result of step SA9, the pixel value difference change 
process of step SA10, the determination result of step SA15, and the 
pixel value inversion process of step SA16. 

15 Specifically, the encoding section 109 sets the pixel value 

difference between the yellow left-side mean pixel value data D y i and 
the yellow right-side mean pixel value data D yr to T for the pair of blocks 
for which the determination result of the step SA9 is "Yes" so as to 
satisfy the magnitude relationship between the yellow left-side mean 

20 pixel value data D y i and the yellow right-side mean pixel value data D yr . 
In addition, the encoding section 109 generates the coded image data 
12 corresponding to the changed yellow left-side mean pixel value data 
D y i and the changed yellow right-side mean pixel value data D yr for the 
pair of blocks for which the determination result of the step SA15 is 

25 "Yes" based on the pixel value inversion process of the step SA16. A 



decoder 200 that decodes the coded image data 12 is explained later. 

The same code C (1010110101001010) is embedded eight times 
into the regions A<| to A 8 in the coded image data 12 illustrated in Fig. 6. 

Fig. 11 is a block diagram of the decoder 200 according to the 
5 first embodiment of the present invention. The decoder 200 decodes 
the embedded code from the coded image data 12, which is encoded by 
the encoder 100. 

If a blank part is present around the coded image data 12, an 
image cutout section 201 in the decoder 200, cuts out the significant 
10 part, which is the coded image data 12, from the entire image data. If 
only the coded image data 12 is input to the image cutout section 201, 
data cutout is not performed. 

A block division section 202 divides the coded image data 12 
into blocks in N rows and M columns (16 rows and 16 columns in Fig. 5), 
15 and outputs the blocks as block division image data (not shown), similar 
to the block division image data 11 illustrated in Fig. 5. 

A block extraction section 203, similar to the block extraction 
section 102 (see Fig. 1), sequentially extracts pairs of blocks (each pair 
including two adjacent blocks) from the block division image data so as 
20 to follow the bit shift of the decoded code (of 16 bits), and sequentially 
outputs pixel value distribution of the yellow components in the paired 
blocks (each pair including two adjacent blocks) as yellow block pixel 
value data (not shown). 

However, the yellow block pixel value data includes the yellow 
25 components included in the cyan and magenta inks as unnecessary 
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components. 

An averaging section 204, similarly to the yellow averaging 
section 103 (see Fig. 1), calculates yellow left-side mean pixel value 
data corresponding to the left block and yellow right-side mean pixel 
5 value data corresponding to the right block from the yellow block pixel 
value data, and stores the pixel value in registers 205I and 205r, 
respectively. 

A comparison section 206 determines the magnitude 
relationship between the yellow left-side mean pixel value data and the 

10 yellow right-side mean pixel value data stored in the registers 205| and 
205r, respectively, thereby executing bit determination, and outputs a 
code group CG to a decoding section 207. The code group CG 
includes candidate codes to C 8 (see Fig. 12) corresponding to the 
determination of the bit as "0" or "1" using the relational formulas. 

15 Fig. 12 is an illustration for explaining how the decoder 200 

determines the code from a group of candidate codes. Each of the 
candidate codes to C 8 illustrated in Fig. 12 has 16 bits. The codes 
Ci to C 8 are obtained by decoding the codes (each of 16 bits) 
embedded into the regions to A 8 in the coded image data 12, 

20 respectively, and are candidates of a code C to be obtained as a result 
of decoding performed by the decoder 200. 

Further, in each of the candidate codes C<i to C 8 , "2" represents 
a bit which is not defined as "1" or "0". 

The comparison section compares the bits in the candidate 

25 codes to C 8 bit by bit. For each bit position, a majority value of the 
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bit is considered as the bit value for the code C. The decoding 
section 207 then outputs the code C\ 

The respective constituent elements of the decoder 200 are 
connected to one another through a control section, which is not shown 
5 in the figure. 

Fig. 1 3 is a flowchart of an operation of the decoder 200. 

At step SB1, the coded image data 12 is input to the image 
cutout section 201. At step SB2, n is initialized to one, where n 
represents the bit pointer of the code to be decoded. In this example, 
10 n=1 corresponds to the leftmost bit of the code. 

At step SB3, if a blank part is present around the coded image 
data 12, the image cutout section 201 cuts out the significant part, which 
is the coded image data 12, from the entire image data. 

At step SB4, the block division section 202 divides the coded 
15 image data 12 into blocks, and sends the blocks to the block extraction 
section 203 as block division image data. 

At step SB5, the block extraction section 203 extracts pairs of 
blocks corresponding to n=1 from the block division image data, and 
then outputs yellow pixel value distribution in the respective blocks to 
20 the averaging section 204 as yellow block pixel value data. 

At step SB6, the averaging section 204 calculates the yellow 
left-side mean pixel value data corresponding to a left block and the 
yellow right-side mean pixel value data corresponding to the right block, 
from the yellow block pixel value data. 
25 At step SB7, the averaging section 204 stores the yellow 



left-side mean pixel value data in the register 205| and stores the yellow 
right-side mean pixel value data in the register 205 r . 

At step SB8, the comparison section 206 determines the 
magnitude relationship between the yellow left-side mean pixel value 
5 data and the yellow right-side mean pixel value data stored in the 
registers 205| and 205 r , respectively, thereby executing bit 
determination, and outputs a bit determination result (determination of 
the bit as "0" or "1" from the relational formulas explained) to the 
decoding section 207. 

10 At this step, the comparison section 206 calculates the 

difference between the yellow left-side mean pixel value data and the 
yellow right-side mean pixel value data. If the pixel value difference is 
greater than a preset upper limit threshold, the comparison section 206 
sets the bit determination result to "2" (undefined: see Fig. 12). 

15 At step SB9, the comparison section 206 increments n by one. 

As a result, n is set to two. At step SB10, the comparison section 206 
determines whether n is greater than 'nend' (=16). In this example, the 
comparison section 206 determines that n is not greater than 'nend' (No 
at step SB10). 

20 Thereafter, the operation after the step SB5 is repeated until the 

determination result of the step SB10 becomes "Yes". 

If n is set to 17 at the step SB9, the determination result of the 
step SB10 becomes "Yes". At this time, the comparison section 206 
sets the candidate code Ci with the bits of the bit determination result. 

25 At step SB11, the comparison section 206 determines whether 
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the processing related to the final pair of blocks in the block division 
image data is complete. In this example, the determination result of 
the step SB11 is "No". 

At step SB14, the comparison section 206 resets n to one. At 
5 the step SB5, the block extraction section 203 extracts the next pair of 
blocks corresponding to n = 1 from the block division image data, and 
then outputs the yellow pixel value distributions in the respective blocks 
to the averaging section 204 as the yellow block pixel value data. 

Thereafter, the operation is repeated until the determination 

10 result of the step SB11 becomes "Yes". 

If the determination result of the step SB11 becomes "Yes", the 
decoding section 207 executes a majority decision processing at a step 
SB12. Namely, at this time, the candidate codes Ci to C 8 illustrated in 
Fig. 12 correspond to the bit determination result. 

15 The decoding section 207 defines each bit of code C (16 bits in 

all) by choosing a majority value per bit position in the candidate codes 
Ci to C 8 . For example, for the leftmost bits of the candidate codes d 
to C 8 , there are two "0"s, five "1"s, and one "2", so that the leftmost bit 
of the code C is defined as "1" by majority. 

20 At step SB13, the decoding section 207 outputs the code C\ 

The code C is assumed to be identical to the code C (see Fig. 1). 

As explained above, according to the first embodiment, the 
coefficient registration section 108 stores in the coefficient information 
108a, in a correlated form, the magenta left-side mean pixel value data 

25 Dmi and the coefficient corresponding to the change quantities of the 
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yellow left-side mean pixel value data D y i and the yellow right-side 
mean pixel value data D yr . The encoding section 109 changes the 
yellow left-side mean pixel value data D y i and the yellow right-side 
mean pixel value data D yr according to the magenta left-side mean pixel 
5 value data D m! in the pairs of blocks, based on the coefficient 
information 108a, thereby embedding the code. Therefore, it is 
possible to deal with the adverse effect of the unnecessary reflected 
wavelengths of the ink of the color component different from the ink of 
the color component into which the code is embedded, on the code 

10 detection. 

Moreover, the encoding section 109 sets one-bit code 
corresponding to each pair of blocks based on the magnitude 
4 relationship between the yellow left-side mean pixel value data D y i and 
the yellow right-side mean pixel value data D yr for each paired block. 

15 Therefore, it is possible to reduce processing load required to embed 
the code, and without performing FFT. Further, the adverse effect of 
the unnecessary reflected wavelengths on the code detection is 
controlled. 

Furthermore, the encoding section 109 embeds the code into 
20 the yellow component, which has characteristics closer to the ideal 
characteristics. Therefore, the yellow component does not have a 
great effect on the cyan and magenta components. Besides, using the 
fact that the yellow component is inconspicuous, code detection ability 
can be maintained without degrading the image. 
25 Moreover, the encoding section 109 sets the change quantities 



of the yellow left-side mean pixel value data D y i and the yellow 
right-side mean pixel value data D yr based on the magenta left-side 
mean pixel value data D m |. Therefore, the pixel value of the yellow 
component can be appropriately changed based on the pixel value of 
5 the magenta component. 

Furthermore, the coefficient of the formula (6), illustrated in Fig. 
8, is set by referring to the coefficient information illustrated in Fig. 9. 
Alternatively, a coefficient may be selected based on a difference in 
magenta mean pixel value in the pair of blocks. This instance will be 

10 explained as the second embodiment. 

Fig. 14 is a block diagram of an encoder 300 according to a 
second embodiment. As a specific example of the image data 
processing apparatus according to the second embodiment, the 
encoder 300 that embeds a binary code into an image data and that 

15 generates coded image data will be explained. A decoder for reading 
the code from the coded image data is identical to the decoder 200 
illustrated in Fig. 11 . 

In Fig. 14, sections corresponding to the respective sections 
illustrated in Fig. 1 are denoted by the same reference symbols and are 

20 not explained herein. 

In Fig. 14, a pixel value difference calculation section 301 and a 
D register 302 are provided in the encoder 300. In addition, a 
coefficient registration section 303 and an encoding section 304 are 
provided in place of the coefficient registration section 108 and the 

25 encoding section 109 of Fig. 1, respectively. 
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The pixel value difference calculation section 301 calculates an 
absolute value |D m i - D mr | of the difference between the magenta 
left-side mean pixel value data D m i and the magenta right-side mean 
pixel value data D mr calculated by the magenta averaging section 105, 
5 as a magenta mean pixel value difference D md , and stores the magenta 
mean pixel value differences D md in the D register 302. 

The coefficient registration section 303 stores a change in the 
yellow component block mean pixel value corresponding to the magenta 
left-side mean pixel value data D mi and the magenta mean pixel value 
10 difference D md . Specifically, the coefficient registration section 303 

registers information on coefficients of mathematical formulas (see Figs. 
7 and 8) employed to change the block mean pixel value of the yellow 
component. 

Fig. 15 illustrates coefficient information 303a stored in the 
15 coefficient registration section 303. In the coefficient information 303a, 
low-pixel value-side magenta mean densities, magenta-mean pixel 
value differences, and coefficients are registered in correlated form. 

For instance, if the magenta mean pixel value difference D md is 
"0 to 10" for the low-pixel value-side magenta mean pixel value "0 to 
20 25" represented by eight bits, a coefficient "1" is registered 

corresponding to the magenta mean pixel value difference D md . If the 
magenta mean pixel value difference D md is "11 to 20" for the low-pixel 
value-side magenta mean pixel value "0 to 25", a coefficient "2" is 
registered corresponding to the magenta mean pixel value difference 
25 D md . If the magenta mean pixel value difference D md is "21 to 40" for 



the low-pixel value-side magenta mean pixel value "0 to 25", a 
coefficient "3" is registered corresponding to the magenta mean pixel 
value difference D md . If the magenta mean pixel value difference D md 
is "41 to 255" for the low-pixel value-side magenta mean pixel value "0 
5 to 25", a coefficient "5" is registered corresponding to the magenta 
mean pixel value difference D md . Likewise, for the other low-pixel 
value-side magenta mean densities, coefficients corresponding to the 
respective magenta mean pixel value difference D md , are registered. 

The encoding section 304 executes a process for embedding the 

10 code C into the block division image data 11 based on a comparison 
done by the comparison section 107, the magenta left-side mean pixel 
value data D m i and magenta right-side mean pixel value data D mr 
calculated by the magenta averaging section 105, and the magenta 
mean pixel value difference D md calculated by the mean difference 

15 calculation section 301 . 

Specifically, if the comparison done by the comparison section 
107 indicates that the code C matches the bit determination result, the 
encoding section 304 sets the pixel value difference between the yellow 
left-side mean pixel value data D yi and the yellow right-side mean pixel 

20 value data D yr to the predetermined value T so as to satisfy the 

magnitude relationship between the yellow left-side mean pixel value 
data D y i and the yellow right-side mean pixel value data D yr . If the 
values do not match, the encoding section 304 changes the yellow 
left-side mean pixel value data D y i and the yellow right-side mean pixel 

25 value data D yr (inverts the magnitude relationship) so as to satisfy the 
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magnitude relationship representing the bits of the code C. Thereafter, 
the encoding section 304 generates and outputs the coded image data 
12 (see Fig. 6). 

Specifically, if the magnitude relationship between the yellow 
5 left-side mean pixel value data D y iand the yellow right-side mean pixel 
value data D yr is D y i < D yr , and the magnitude relationship is satisfied, 
or if the magnitude relationship between the yellow left-side mean pixel 
value data D yi and the yellow right-side mean pixel value data D yr is 
inverted to D y i<D yr , the encoding section 304 calculates changed yellow 

10 left-side mean pixel value data D' yi from the formula (1) for case (A) 
D y i<D yr illustrated in Fig. 7 and then calculates changed yellow 
right-side mean pixel value data D' yr from the formula (2). 

The predetermined value T is initialized (e.g., T=T0=10), and the 
yellow left-side mean pixel value data D' y i and the yellow right-side 

15 mean pixel value data D' yr are calculated. Thereafter, using the 

magenta left-side mean pixel value data D m i and the magenta right-side 
mean pixel value data D mr calculated by the magenta averaging section 
105, the value T is corrected according to the conditions illustrated in 
Fig. 8. 

20 Namely, if (A) D'y^DV and D m i<D mr , or if D' y i>D' yr and D m i>D mr , 

the encoding section 304 substitutes the value T from the formula (5) in 
the formulas (1) to (4). If (B) D'y^D'yr and D m i D mr , or if D'y^D'yr and 

the encoding section 304 substitutes the value T from the 
formula (6) in the formulas (1) to (4). 

25 The coefficient in the formula (6) is determined by referring to 
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the coefficient information 303a illustrated in Fig. 15 and by extracting 
the coefficient corresponding to the low-pixel value-side magenta mean 
pixel value of the magenta left-side mean pixel value data D m i and the 
magenta right-side mean pixel value data D m r. 
5 On the other hand, if the magnitude relationship between the 

yellow left-side mean pixel value data D y i and the yellow right-side 
mean pixel value data D yr is D y) D yr and the magnitude relationship is 
satisfied, or if the magnitude relationship between then is reversed to 
D y i D yr , then the encoding section 109 calculates the changed yellow 

10 left-side mean pixel value data D' y i from the formula (3) for case (B) 
D y i D yr and then calculates the changed yellow right-side mean pixel 
value data D' yr from the formula (4). A method of setting the value T is 
the same as the method used for (A) D y i<D yr illustrated in Fig. 7. 

An example of an operation of the encoder 300 illustrated in Fig. 

15 14 will next be explained with reference to flowcharts illustrated in Figs. 
16A and 16B. The flowcharts in Fig. 16 and Fig. 10 are different in 
that a step SC7 in Fig. 16A is added to the flowchart illustrated in Fig. 
10A. A step SC8 illustrated in Fig. 16A and steps SC11 and SC17 
illustrated in Fig. 16B differ in processing content from the step SA7 

20 illustrated in Fig. 10A and the steps SC10 and SA16 illustrated in Fig. 
10B, respectively. 

Because steps SC1 to SC6, SC9, S10, SC12 to SC16, and 
SC18 illustrated in Figs. 16A and 16B correspond to the steps SA1 to 
SA6, SA8, SA9, SA11 to SA15, and SA17 illustrated in Figs. 10A and 

25 10B, respectively, the explanation is omitted herein. 



At step SC7 illustrated in Fig. 16A, the pixel value difference 
calculation section 301 calculates the absolute value |D m i - D mr | of the 
difference between the magenta left-side mean pixel value data D m i and 
the magenta right-side mean pixel value data D mr calculated by the 
5 magenta averaging section 105, as the magenta mean pixel value 
difference D md . 

At step SC8, the yellow averaging section 103 stores the yellow 
left-side mean pixel value data D yt and the yellow right-side mean pixel 
value data D yr in the L register 104| and the R register 104 r , respectively. 

10 The magenta averaging section 105 stores the magenta left-side mean 
pixel value data D m i and the magenta right-side mean pixel value data 
D mr in the L register 106| and the R register 106 r , respectively. The 
pixel value difference calculations section 301 stores the magenta 
mean pixel value difference data D md in the D register 302. 

15 At step SC11 illustrated in Fig. 16B, the encoding section 109 

executes a pixel value difference change process for setting the pixel 
value difference between the yellow left-side mean pixel value data D yi 
and the yellow right-side mean pixel value data D yr to T so as to satisfy 
the magnitude relationship between the yellow left-side mean pixel 

20 value data D y i and the yellow right-side mean pixel value data D yr , using 
the formulas illustrated in Figs. 7 and 8 and the coefficient information 
303a illustrated in Fig. 15. 

At step SC17, the encoding section 304 executes a pixel value 
inversion process for inverting the magnitude relationship between the 

25 yellow left-side mean pixel value data D y , and the yellow right-side 



mean pixel value data D yr so that the bit determination result based on 
the magnitude relationship between the yellow left-side mean pixel 
value data D y i and the yellow right-side mean pixel value data D yr 
matches the n-th bit of the code C. 
5 Namely, using the formulas illustrated in Figs. 7 and 8 and the 

coefficient information 303a illustrated in Fig. 15, the encoding section 
304 inverts the magnitude relationship between the yellow left-side 
mean pixel value data D y i and the yellow right-side mean pixel value 
data D yr . 

10 As explained above, according to the second embodiment, the 

coefficient registration section 303 registers, as the coefficient 
information 303a, the low-pixel value-side magenta mean pixel value 
data as the lower value of the magenta left-side mean pixel value data 
D m i and the magenta right-side mean pixel value data D m i, the magenta 

15 mean pixel value difference D md , the coefficients related to the change 
quantities of the yellow left-side mean pixel value data D y! and the 
yellow right-side mean pixel value data D yr . The encoding section 304 
changes the yellow left-side mean pixel value data D y! and the yellow 
right-side mean pixel value data D yr according to the low-pixel 

20 value-side magenta mean pixel value data and the magenta mean pixel 
value difference D md in the pairs of blocks using the registered 
coefficient information 303a, thereby embedding the code. Therefore, 
it is possible to avoid the adverse effect of the unnecessary reflected 
wavelengths of the ink of the color component different from the ink of 

25 the color component into which the code is embedded, on the code 
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detection. 

The embodiments of the present invention have been explained 
with reference to the drawings in detail. However, specific 
constitutional examples are not limited to these embodiments, and even 
5 changes and the like in design made within the scope of the present 
invention are included in the present invention. 

For instance, Fig. 17 illustrates a configuration of a modification 
of the embodiments of the present invention. A program for realizing 
functions of the encoder 100, the decoder 200, and the encoder 300 
10 may be recorded on a computer readable recording medium 500. The 
program recorded on the recording medium 500 may be read and 
executed by a computer 400, whereby the respective functions may be 
realized. 

The computer 400 includes a CPU (Central Processing Unit) 410 
15 that executes the program, an input device 420 such as a keyboard and 
a mouse, a ROM (Read Only Memory) 430 that stores data, a RAM 
(Random Access Memory) 440 that stores operation parameters and 
the like, a reading device 450 that reads the program from the recording 
medium 500, and an output device 460 such as a display and a printer. 
20 The CPU 410 reads the program recorded on the recording 

medium 500 through the reading device 450, executes the program, 
and thereby realizes the functions. Examples of the recording medium 
500 include an optical disk, a flexible disk, and a hard disk. This 
program may be introduced into the computer 400 through a network 
25 such as the Internet. 



According to the first and the second embodiments, if the n-th 
bit of the code C coincides with the bit determination result determined 
from the magnitude relationship between the yellow left-side mean pixel 
value data D y i and the yellow right-side mean pixel value data D yr , the 
5 pixel value difference between the yellow left-side mean pixel value 

data D y i and the yellow right-side mean pixel value data D yr is set to the 
predetermined value T while keeping the magnitude relationship 
between the yellow left-side mean pixel value data D y i and the yellow 
right-side mean pixel value data D yr so as to improve decoding 

10 efficiency. However, the present invention is not limited to the 

embodiments, and the processing may be omitted so as to improve 
processing speed. 

Further, according to the first and the second embodiments, the 
effect of the magenta component on the yellow component has been 

15 considered. However, the present invention is not limited to the 

embodiments and may be applied to a combination of the other color 
components. Furthermore, the effect of the cyan component and that 
of the black component on the yellow component besides the effect of 
the magenta component may be also considered. 

20 According to the present invention, it is possible to avoid the 

adverse effect of the unnecessary reflected wavelengths of the ink of 
the color component different from the ink of the color component into- 
which the code is embedded, on the code detection. 

Furthermore, it is possible to reduce a processing load required 

25 to embed the code without performing the FFT. 
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Moreover, it is possible to maintain code detection ability without 
degrading the image. 

Furthermore, it is possible to appropriately change the pixel 
value of the yellow component based on the pixel value of the magenta 
component that greatly affects the reflected wavelengths of the yellow 
component. 

Although the invention has been described with respect to a 
specific embodiment for a complete and clear disclosure, the appended 
claims are not to be thus limited but are to be construed as embodying 
all modifications and alternative constructions that may occur to one 
skilled in the art which fairly fall within the basic teaching herein set 
forth. 
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